Update dependency tsx to v4.19.1 #434

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	192	5823 total, 0 failed	avg: 339ms, p95: 790ms	✅
apollo-router	175	5353 total, 0 failed	avg: 500ms, p95: 677ms	✅
wundergraph	151	4609 total, 0 failed	avg: 537ms, p95: 962ms	✅
mesh-supergraph-bun	70	2187 total, 0 failed	avg: 1380ms, p95: 2383ms	✅
apollo-server	53	1659 total, 0 failed	avg: 1839ms, p95: 2352ms	✅
mercurius	29	910 total, 0 failed	avg: 3325ms, p95: 4424ms	✅
mesh-supergraph	24	763 total, 0 failed	avg: 4027ms, p95: 6433ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17469      ✗ 0    
     data_received..................: 511 MB  17 MB/s
     data_sent......................: 6.9 MB  228 kB/s
     http_req_blocked...............: avg=64.49µs  min=1.24µs  med=2.8µs    max=173.81ms p(90)=4.27µs   p(95)=5.62µs  
     http_req_connecting............: avg=58.71µs  min=0s      med=0s       max=173.74ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=338.92ms min=7.01ms  med=296.61ms max=1.85s    p(90)=640.84ms p(95)=789.67ms
       { expected_response:true }...: avg=338.92ms min=7.01ms  med=296.61ms max=1.85s    p(90)=640.84ms p(95)=789.67ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5823 
     http_req_receiving.............: avg=99.1ms   min=37.97µs med=85.84µs  max=1.6s     p(90)=422.4ms  p(95)=592.26ms
     http_req_sending...............: avg=3.8ms    min=8.48µs  med=13.28µs  max=811.17ms p(90)=51.29µs  p(95)=958.25µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=236ms    min=6.89ms  med=216.37ms max=898.1ms  p(90)=428.71ms p(95)=480.49ms
     http_reqs......................: 5823    192.092448/s
     iteration_duration.............: avg=518.1ms  min=19.33ms med=453.67ms max=2.81s    p(90)=981.66ms p(95)=1.21s   
     iterations.....................: 5823    192.092448/s
     vus............................: 97      min=97       max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 16059      ✗ 0    
     data_received..................: 470 MB  15 MB/s
     data_sent......................: 6.4 MB  209 kB/s
     http_req_blocked...............: avg=103.8µs  min=1.7µs   med=3.19µs   max=135.37ms p(90)=5.13µs   p(95)=6.67µs  
     http_req_connecting............: avg=43.67µs  min=0s      med=0s       max=6.23ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=500.16ms min=83.96ms med=493.24ms max=1.57s    p(90)=623.67ms p(95)=677.36ms
       { expected_response:true }...: avg=500.16ms min=83.96ms med=493.24ms max=1.57s    p(90)=623.67ms p(95)=677.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5353 
     http_req_receiving.............: avg=17.28ms  min=36.07µs med=76.76µs  max=994.82ms p(90)=48.61ms  p(95)=107.44ms
     http_req_sending...............: avg=1.38ms   min=7.36µs  med=14.23µs  max=581.2ms  p(90)=41.24µs  p(95)=914.5µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=481.5ms  min=83.86ms med=481.51ms max=912.95ms p(90)=594.29ms p(95)=633.44ms
     http_reqs......................: 5353    175.781037/s
     iteration_duration.............: avg=564.86ms min=93.74ms med=536.62ms max=1.7s     p(90)=747.48ms p(95)=841.11ms
     iterations.....................: 5353    175.781037/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 13827      ✗ 0    
     data_received..................: 404 MB  13 MB/s
     data_sent......................: 5.5 MB  180 kB/s
     http_req_blocked...............: avg=88.64µs  min=1.38µs  med=2.92µs   max=236.02ms p(90)=4.55µs   p(95)=6.02µs  
     http_req_connecting............: avg=68.39µs  min=0s      med=0s       max=235.95ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=536.6ms  min=23.77ms med=519.7ms  max=2.24s    p(90)=833.6ms  p(95)=961.61ms
       { expected_response:true }...: avg=536.6ms  min=23.77ms med=519.7ms  max=2.24s    p(90)=833.6ms  p(95)=961.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 4609 
     http_req_receiving.............: avg=43.18ms  min=35.67µs med=84.36µs  max=2.14s    p(90)=114.93ms p(95)=287.99ms
     http_req_sending...............: avg=3ms      min=8.03µs  med=13.83µs  max=1.31s    p(90)=45.81µs  p(95)=423.07µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=490.4ms  min=20.5ms  med=481.03ms max=1.35s    p(90)=775.72ms p(95)=867.02ms
     http_reqs......................: 4609    151.911297/s
     iteration_duration.............: avg=654.96ms min=34.6ms  med=600.79ms max=2.82s    p(90)=1.02s    p(95)=1.24s   
     iterations.....................: 4609    151.911297/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6561      ✗ 0    
     data_received..................: 192 MB  6.2 MB/s
     data_sent......................: 2.6 MB  84 kB/s
     http_req_blocked...............: avg=57.39µs  min=1.55µs   med=3.95µs   max=4.78ms  p(90)=7.02µs  p(95)=22.37µs 
     http_req_connecting............: avg=42.81µs  min=0s       med=0s       max=4.16ms  p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.38s    min=359.41ms med=1.19s    max=3.76s   p(90)=2.24s   p(95)=2.38s   
       { expected_response:true }...: avg=1.38s    min=359.41ms med=1.19s    max=3.76s   p(90)=2.24s   p(95)=2.38s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2187 
     http_req_receiving.............: avg=15.34ms  min=39.89µs  med=135.58µs max=1.54s   p(90)=2.42ms  p(95)=68.47ms 
     http_req_sending...............: avg=415.05µs min=8.61µs   med=20.58µs  max=84.05ms p(90)=58.03µs p(95)=228.01µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.36s    min=358.89ms med=1.18s    max=3.48s   p(90)=2.21s   p(95)=2.37s   
     http_reqs......................: 2187    70.323043/s
     iteration_duration.............: avg=1.4s     min=369.12ms med=1.22s    max=3.77s   p(90)=2.27s   p(95)=2.42s   
     iterations.....................: 2187    70.323043/s
     vus............................: 10      min=10      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4977      ✗ 0    
     data_received..................: 146 MB  4.7 MB/s
     data_sent......................: 2.0 MB  63 kB/s
     http_req_blocked...............: avg=148.24µs min=1.63µs   med=3.33µs   max=5.75ms p(90)=5.67µs   p(95)=487.77µs
     http_req_connecting............: avg=135.98µs min=0s       med=0s       max=5.49ms p(90)=0s       p(95)=240.28µs
     http_req_duration..............: avg=1.83s    min=784.92ms med=1.54s    max=19.56s p(90)=1.85s    p(95)=2.35s   
       { expected_response:true }...: avg=1.83s    min=784.92ms med=1.54s    max=19.56s p(90)=1.85s    p(95)=2.35s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1659 
     http_req_receiving.............: avg=171.63µs min=49.8µs   med=117.93µs max=6.17ms p(90)=189.61µs p(95)=260.81µs
     http_req_sending...............: avg=44.89µs  min=9.27µs   med=17.21µs  max=5.72ms p(90)=36.19µs  p(95)=122.76µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.83s    min=784.71ms med=1.54s    max=19.56s p(90)=1.85s    p(95)=2.35s   
     http_reqs......................: 1659    53.113932/s
     iteration_duration.............: avg=1.85s    min=790.68ms med=1.55s    max=19.56s p(90)=1.86s    p(95)=2.36s   
     iterations.....................: 1659    53.113932/s
     vus............................: 33      min=33      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2730      ✗ 0    
     data_received..................: 80 MB   2.6 MB/s
     data_sent......................: 1.1 MB  35 kB/s
     http_req_blocked...............: avg=173.98µs min=1.48µs   med=3.69µs   max=4.74ms  p(90)=131.65µs p(95)=1.41ms  
     http_req_connecting............: avg=151.74µs min=0s       med=0s       max=4.7ms   p(90)=88.51µs  p(95)=1.37ms  
     http_req_duration..............: avg=3.32s    min=626.53ms med=3.16s    max=7.73s   p(90)=4.13s    p(95)=4.42s   
       { expected_response:true }...: avg=3.32s    min=626.53ms med=3.16s    max=7.73s   p(90)=4.13s    p(95)=4.42s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 910  
     http_req_receiving.............: avg=345.92µs min=42.24µs  med=114.79µs max=71.08ms p(90)=226.55µs p(95)=334.67µs
     http_req_sending...............: avg=90µs     min=9.54µs   med=20.62µs  max=1.87ms  p(90)=52.1µs   p(95)=504.13µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.32s    min=626.46ms med=3.16s    max=7.73s   p(90)=4.13s    p(95)=4.42s   
     http_reqs......................: 910     29.717053/s
     iteration_duration.............: avg=3.33s    min=634.95ms med=3.17s    max=7.76s   p(90)=4.14s    p(95)=4.43s   
     iterations.....................: 910     29.717053/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2289      ✗ 0    
     data_received..................: 67 MB   2.1 MB/s
     data_sent......................: 906 kB  29 kB/s
     http_req_blocked...............: avg=429.62µs min=1.48µs  med=4.04µs   max=6.39ms   p(90)=2.04ms   p(95)=3.91ms  
     http_req_connecting............: avg=395.21µs min=0s      med=0s       max=6.34ms   p(90)=1.79ms   p(95)=3.65ms  
     http_req_duration..............: avg=4.02s    min=1.1s    med=3.89s    max=7.73s    p(90)=5.72s    p(95)=6.43s   
       { expected_response:true }...: avg=4.02s    min=1.1s    med=3.89s    max=7.73s    p(90)=5.72s    p(95)=6.43s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 763  
     http_req_receiving.............: avg=2.47ms   min=41.12µs med=138.24µs max=102.42ms p(90)=2.65ms   p(95)=5.13ms  
     http_req_sending...............: avg=72.7µs   min=8.33µs  med=23.39µs  max=2.91ms   p(90)=137.92µs p(95)=396.87µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.02s    min=1.1s    med=3.89s    max=7.73s    p(90)=5.72s    p(95)=6.42s   
     http_reqs......................: 763     24.268343/s
     iteration_duration.............: avg=4.04s    min=1.12s   med=3.9s     max=7.74s    p(90)=5.74s    p(95)=6.46s   
     iterations.....................: 763     24.268343/s
     vus............................: 46      min=46      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:12:53Z

Overview for: `federation-v1/constant-vus-subgraphs-delay-resources`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	183	5541 total, 0 failed	avg: 309ms, p95: 877ms	✅
apollo-router	161	4914 total, 0 failed	avg: 344ms, p95: 925ms	✅
wundergraph	151	4612 total, 0 failed	avg: 365ms, p95: 996ms	✅
mesh-supergraph-bun	95	2952 total, 0 failed	avg: 993ms, p95: 1616ms	✅
apollo-server	71	2215 total, 0 failed	avg: 1367ms, p95: 1562ms	✅
mesh-supergraph	53	1675 total, 0 failed	avg: 1805ms, p95: 2775ms	✅
mercurius	44	1357 total, 0 failed	avg: 2222ms, p95: 2909ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 16623      ✗ 0    
     data_received..................: 486 MB  16 MB/s
     data_sent......................: 6.6 MB  218 kB/s
     http_req_blocked...............: avg=124.6µs  min=1.51µs  med=2.96µs   max=197.7ms  p(90)=4.43µs   p(95)=5.58µs  
     http_req_connecting............: avg=113.62µs min=0s      med=0s       max=197.4ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=308.64ms min=7.67ms  med=232.32ms max=2.46s    p(90)=672.89ms p(95)=877.49ms
       { expected_response:true }...: avg=308.64ms min=7.67ms  med=232.32ms max=2.46s    p(90)=672.89ms p(95)=877.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5541 
     http_req_receiving.............: avg=128.49ms min=33.92µs med=87.56µs  max=2.35s    p(90)=487.4ms  p(95)=708.97ms
     http_req_sending...............: avg=5.66ms   min=7.35µs  med=14µs     max=1.1s     p(90)=71.64µs  p(95)=6.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=174.47ms min=7.46ms  med=167.97ms max=752.74ms p(90)=310.05ms p(95)=357.86ms
     http_reqs......................: 5541    183.262667/s
     iteration_duration.............: avg=543.48ms min=19.68ms med=429.06ms max=3.16s    p(90)=1.14s    p(95)=1.41s   
     iterations.....................: 5541    183.262667/s
     vus............................: 98      min=98       max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14742      ✗ 0    
     data_received..................: 431 MB  14 MB/s
     data_sent......................: 5.8 MB  192 kB/s
     http_req_blocked...............: avg=168.59µs min=1.53µs  med=3.69µs   max=299.09ms p(90)=5.63µs   p(95)=10.36µs 
     http_req_connecting............: avg=115.99µs min=0s      med=0s       max=298.97ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=343.72ms min=14.95ms med=242.58ms max=2.27s    p(90)=772.79ms p(95)=925.3ms 
       { expected_response:true }...: avg=343.72ms min=14.95ms med=242.58ms max=2.27s    p(90)=772.79ms p(95)=925.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4914 
     http_req_receiving.............: avg=140.37ms min=32.97µs med=109.94µs max=1.92s    p(90)=541.94ms p(95)=711.79ms
     http_req_sending...............: avg=5.18ms   min=8.99µs  med=18.77µs  max=1.26s    p(90)=119.17µs p(95)=1.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=198.15ms min=14.83ms med=188.32ms max=691.05ms p(90)=337.31ms p(95)=375.55ms
     http_reqs......................: 4914    161.968288/s
     iteration_duration.............: avg=614.28ms min=25.14ms med=507.76ms max=3.25s    p(90)=1.25s    p(95)=1.5s    
     iterations.....................: 4914    161.968288/s
     vus............................: 89      min=89       max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 13836      ✗ 0    
     data_received..................: 405 MB  13 MB/s
     data_sent......................: 5.5 MB  180 kB/s
     http_req_blocked...............: avg=335.07µs min=1.55µs  med=3.83µs   max=868.92ms p(90)=5.8µs    p(95)=7.35µs  
     http_req_connecting............: avg=70.5µs   min=0s      med=0s       max=148.32ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=364.95ms min=14.49ms med=262.59ms max=2.36s    p(90)=791.17ms p(95)=995.54ms
       { expected_response:true }...: avg=364.95ms min=14.49ms med=262.59ms max=2.36s    p(90)=791.17ms p(95)=995.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 4612 
     http_req_receiving.............: avg=157.67ms min=40.12µs med=253.67µs max=2.12s    p(90)=566.9ms  p(95)=740.47ms
     http_req_sending...............: avg=7.11ms   min=8.37µs  med=19µs     max=1.24s    p(90)=121.78µs p(95)=2.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=200.16ms min=14.35ms med=188.48ms max=842.95ms p(90)=334.29ms p(95)=393.49ms
     http_reqs......................: 4612    151.751894/s
     iteration_duration.............: avg=654.88ms min=27.44ms med=538.61ms max=3.42s    p(90)=1.35s    p(95)=1.63s   
     iterations.....................: 4612    151.751894/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 8856      ✗ 0    
     data_received..................: 259 MB  8.4 MB/s
     data_sent......................: 3.5 MB  114 kB/s
     http_req_blocked...............: avg=19.76µs  min=1.53µs   med=2.96µs   max=3.31ms   p(90)=4.77µs  p(95)=9.84µs  
     http_req_connecting............: avg=13.54µs  min=0s       med=0s       max=3.11ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=992.78ms min=107ms    med=850.38ms max=2.2s     p(90)=1.51s   p(95)=1.61s   
       { expected_response:true }...: avg=992.78ms min=107ms    med=850.38ms max=2.2s     p(90)=1.51s   p(95)=1.61s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2952 
     http_req_receiving.............: avg=15.15ms  min=38.27µs  med=95.04µs  max=536.92ms p(90)=17.39ms p(95)=110.52ms
     http_req_sending...............: avg=737.02µs min=8.02µs   med=13.8µs   max=192.52ms p(90)=51.34µs p(95)=204.88µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=976.89ms min=106.81ms med=840.3ms  max=2.11s    p(90)=1.5s    p(95)=1.6s    
     http_reqs......................: 2952    95.764628/s
     iteration_duration.............: avg=1.03s    min=116.23ms med=892.16ms max=2.23s    p(90)=1.57s   p(95)=1.69s   
     iterations.....................: 2952    95.764628/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6645      ✗ 0    
     data_received..................: 195 MB  6.3 MB/s
     data_sent......................: 2.6 MB  85 kB/s
     http_req_blocked...............: avg=143.21µs min=1.59µs   med=3.34µs   max=7.61ms  p(90)=5.29µs  p(95)=15.9µs  
     http_req_connecting............: avg=135.93µs min=0s       med=0s       max=7.49ms  p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.36s    min=494ms    med=1.25s    max=14.5s   p(90)=1.43s   p(95)=1.56s   
       { expected_response:true }...: avg=1.36s    min=494ms    med=1.25s    max=14.5s   p(90)=1.43s   p(95)=1.56s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2215 
     http_req_receiving.............: avg=183.3µs  min=46.56µs  med=112.24µs max=21.4ms  p(90)=184.9µs p(95)=277.61µs
     http_req_sending...............: avg=45.45µs  min=9.12µs   med=17.26µs  max=23.88ms p(90)=36.17µs p(95)=84.94µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.36s    min=493.69ms med=1.25s    max=14.5s   p(90)=1.43s   p(95)=1.56s   
     http_reqs......................: 2215    71.547517/s
     iteration_duration.............: avg=1.38s    min=506.68ms med=1.26s    max=14.51s  p(90)=1.44s   p(95)=1.57s   
     iterations.....................: 2215    71.547517/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5025      ✗ 0    
     data_received..................: 147 MB  4.7 MB/s
     data_sent......................: 2.0 MB  64 kB/s
     http_req_blocked...............: avg=55.17µs  min=1.64µs   med=3.96µs   max=3.89ms   p(90)=5.83µs  p(95)=219.3µs 
     http_req_connecting............: avg=41.81µs  min=0s       med=0s       max=2.64ms   p(90)=0s      p(95)=162.95µs
     http_req_duration..............: avg=1.8s     min=612.96ms med=1.73s    max=4.56s    p(90)=2.54s   p(95)=2.77s   
       { expected_response:true }...: avg=1.8s     min=612.96ms med=1.73s    max=4.56s    p(90)=2.54s   p(95)=2.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1675 
     http_req_receiving.............: avg=1.78ms   min=36.47µs  med=141.36µs max=152.92ms p(90)=2.81ms  p(95)=5.69ms  
     http_req_sending...............: avg=213.39µs min=8.57µs   med=22.13µs  max=71.23ms  p(90)=46.36µs p(95)=289.77µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.8s     min=609.35ms med=1.73s    max=4.55s    p(90)=2.53s   p(95)=2.77s   
     http_reqs......................: 1675    53.897912/s
     iteration_duration.............: avg=1.83s    min=629.07ms med=1.75s    max=4.57s    p(90)=2.56s   p(95)=2.88s   
     iterations.....................: 1675    53.897912/s
     vus............................: 13      min=13      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4071      ✗ 0    
     data_received..................: 119 MB  3.9 MB/s
     data_sent......................: 1.6 MB  53 kB/s
     http_req_blocked...............: avg=184.67µs min=1.66µs   med=4.55µs   max=5.18ms  p(90)=6.96µs   p(95)=1.34ms  
     http_req_connecting............: avg=169.26µs min=0s       med=0s       max=5.05ms  p(90)=0s       p(95)=1.31ms  
     http_req_duration..............: avg=2.22s    min=539.96ms med=2.18s    max=4.66s   p(90)=2.73s    p(95)=2.9s    
       { expected_response:true }...: avg=2.22s    min=539.96ms med=2.18s    max=4.66s   p(90)=2.73s    p(95)=2.9s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 1357 
     http_req_receiving.............: avg=440.44µs min=46.94µs  med=125.13µs max=70.99ms p(90)=245.82µs p(95)=448.65µs
     http_req_sending...............: avg=43.26µs  min=9.54µs   med=26.49µs  max=2.51ms  p(90)=45.29µs  p(95)=129.38µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.22s    min=539.73ms med=2.18s    max=4.66s   p(90)=2.73s    p(95)=2.9s    
     http_reqs......................: 1357    44.372991/s
     iteration_duration.............: avg=2.23s    min=552.49ms med=2.2s     max=4.68s   p(90)=2.76s    p(95)=2.91s   
     iterations.....................: 1357    44.372991/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:13:05Z

Overview for: `federation-v1/constant-vus-subgraphs-delay`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	194	5888 total, 0 failed	avg: 328ms, p95: 743ms	✅
apollo-router	171	5245 total, 0 failed	avg: 487ms, p95: 673ms	✅
wundergraph	154	4691 total, 0 failed	avg: 527ms, p95: 971ms	✅
mesh-supergraph-bun	78	2410 total, 0 failed	avg: 1244ms, p95: 2190ms	✅
apollo-server	53	1666 total, 0 failed	avg: 1831ms, p95: 2047ms	✅
mercurius	28	885 total, 0 failed	avg: 3429ms, p95: 4548ms	✅
mesh-supergraph	24	784 total, 0 failed	avg: 4034ms, p95: 6460ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17664      ✗ 0    
     data_received..................: 517 MB  17 MB/s
     data_sent......................: 7.0 MB  231 kB/s
     http_req_blocked...............: avg=264.11µs min=1.24µs  med=2.73µs   max=305.01ms p(90)=4.06µs   p(95)=5.25µs  
     http_req_connecting............: avg=141.03µs min=0s      med=0s       max=304.95ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=328.29ms min=9.06ms  med=280.56ms max=2.21s    p(90)=605.77ms p(95)=743.31ms
       { expected_response:true }...: avg=328.29ms min=9.06ms  med=280.56ms max=2.21s    p(90)=605.77ms p(95)=743.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5888 
     http_req_receiving.............: avg=82.21ms  min=35.99µs med=77.22µs  max=1.92s    p(90)=346.04ms p(95)=516.68ms
     http_req_sending...............: avg=6.05ms   min=8.22µs  med=13.37µs  max=1.29s    p(90)=66.76µs  p(95)=3.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=240.02ms min=8.99ms  med=226.58ms max=784.64ms p(90)=414.53ms p(95)=473.75ms
     http_reqs......................: 5888    194.575774/s
     iteration_duration.............: avg=511.65ms min=19.73ms med=445.94ms max=2.92s    p(90)=964.88ms p(95)=1.16s   
     iterations.....................: 5888    194.575774/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15735      ✗ 0    
     data_received..................: 460 MB  15 MB/s
     data_sent......................: 6.2 MB  203 kB/s
     http_req_blocked...............: avg=137.61µs min=1.56µs  med=3.12µs   max=205.75ms p(90)=5.11µs   p(95)=6.51µs  
     http_req_connecting............: avg=43.15µs  min=0s      med=0s       max=4.57ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=487.15ms min=37.59ms med=490.17ms max=1.25s    p(90)=614.8ms  p(95)=672.84ms
       { expected_response:true }...: avg=487.15ms min=37.59ms med=490.17ms max=1.25s    p(90)=614.8ms  p(95)=672.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5245 
     http_req_receiving.............: avg=19.09ms  min=35.41µs med=74.56µs  max=840.02ms p(90)=37.03ms  p(95)=120.74ms
     http_req_sending...............: avg=1.51ms   min=8.9µs   med=14.45µs  max=456.02ms p(90)=45.05µs  p(95)=198.75µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=466.54ms min=37.34ms med=479.23ms max=858.62ms p(90)=587.32ms p(95)=621.3ms 
     http_reqs......................: 5245    171.391698/s
     iteration_duration.............: avg=578.17ms min=47.52ms med=547.92ms max=1.94s    p(90)=776.53ms p(95)=923.89ms
     iterations.....................: 5245    171.391698/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14073     ✗ 0    
     data_received..................: 412 MB  14 MB/s
     data_sent......................: 5.6 MB  183 kB/s
     http_req_blocked...............: avg=162.19µs min=1.33µs  med=2.79µs   max=321.38ms p(90)=4.3µs    p(95)=6.53µs  
     http_req_connecting............: avg=38.4µs   min=0s      med=0s       max=94.77ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=527.02ms min=15.23ms med=505.36ms max=2.67s    p(90)=858.79ms p(95)=970.81ms
       { expected_response:true }...: avg=527.02ms min=15.23ms med=505.36ms max=2.67s    p(90)=858.79ms p(95)=970.81ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 4691 
     http_req_receiving.............: avg=48.95ms  min=36.59µs med=77.52µs  max=2.05s    p(90)=96.07ms  p(95)=397.32ms
     http_req_sending...............: avg=2.9ms    min=7.38µs  med=13.32µs  max=825.31ms p(90)=34.96µs  p(95)=792.65µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=475.16ms min=11.58ms med=464.09ms max=1.24s    p(90)=783.74ms p(95)=868.42ms
     http_reqs......................: 4691    154.22714/s
     iteration_duration.............: avg=644.76ms min=34.98ms med=584.48ms max=2.69s    p(90)=1.03s    p(95)=1.27s   
     iterations.....................: 4691    154.22714/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7230      ✗ 0    
     data_received..................: 211 MB  6.8 MB/s
     data_sent......................: 2.9 MB  93 kB/s
     http_req_blocked...............: avg=73.36µs  min=1.45µs   med=2.87µs   max=5.6ms    p(90)=5.11µs  p(95)=14.12µs 
     http_req_connecting............: avg=56.9µs   min=0s       med=0s       max=5.56ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.24s    min=304.78ms med=1.06s    max=3.75s    p(90)=1.97s   p(95)=2.18s   
       { expected_response:true }...: avg=1.24s    min=304.78ms med=1.06s    max=3.75s    p(90)=1.97s   p(95)=2.18s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2410 
     http_req_receiving.............: avg=12.25ms  min=38.46µs  med=112.16µs max=514.68ms p(90)=2.03ms  p(95)=48.46ms 
     http_req_sending...............: avg=328.77µs min=8.25µs   med=14.23µs  max=47.52ms  p(90)=39.85µs p(95)=147.22µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.23s    min=304.32ms med=1.05s    max=3.75s    p(90)=1.96s   p(95)=2.16s   
     http_reqs......................: 2410    78.026919/s
     iteration_duration.............: avg=1.26s    min=313.61ms med=1.08s    max=3.85s    p(90)=1.99s   p(95)=2.21s   
     iterations.....................: 2410    78.026919/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4998      ✗ 0    
     data_received..................: 146 MB  4.7 MB/s
     data_sent......................: 2.0 MB  63 kB/s
     http_req_blocked...............: avg=79.63µs  min=1.47µs   med=3.13µs   max=4ms     p(90)=5.25µs   p(95)=213.28µs
     http_req_connecting............: avg=70.53µs  min=0s       med=0s       max=3.97ms  p(90)=0s       p(95)=172.26µs
     http_req_duration..............: avg=1.83s    min=784.29ms med=1.57s    max=18.83s  p(90)=1.89s    p(95)=2.04s   
       { expected_response:true }...: avg=1.83s    min=784.29ms med=1.57s    max=18.83s  p(90)=1.89s    p(95)=2.04s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1666 
     http_req_receiving.............: avg=349.67µs min=44.64µs  med=118.97µs max=66.88ms p(90)=200.12µs p(95)=301.97µs
     http_req_sending...............: avg=49.87µs  min=8.59µs   med=15.92µs  max=15.84ms p(90)=35.19µs  p(95)=121.6µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.83s    min=784.13ms med=1.57s    max=18.83s  p(90)=1.89s    p(95)=2.04s   
     http_reqs......................: 1666    53.329468/s
     iteration_duration.............: avg=1.84s    min=789.88ms med=1.58s    max=18.85s  p(90)=1.9s     p(95)=2.07s   
     iterations.....................: 1666    53.329468/s
     vus............................: 32      min=32      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2655      ✗ 0    
     data_received..................: 78 MB   2.5 MB/s
     data_sent......................: 1.1 MB  34 kB/s
     http_req_blocked...............: avg=374.35µs min=1.74µs   med=4.43µs   max=7.7ms    p(90)=757.38µs p(95)=3.16ms  
     http_req_connecting............: avg=360.85µs min=0s       med=0s       max=7.59ms   p(90)=729.16µs p(95)=3.05ms  
     http_req_duration..............: avg=3.42s    min=770.46ms med=3.21s    max=7.47s    p(90)=4.28s    p(95)=4.54s   
       { expected_response:true }...: avg=3.42s    min=770.46ms med=3.21s    max=7.47s    p(90)=4.28s    p(95)=4.54s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 885  
     http_req_receiving.............: avg=811.64µs min=43.86µs  med=120.69µs max=161.13ms p(90)=224.59µs p(95)=374µs   
     http_req_sending...............: avg=51.1µs   min=9.38µs   med=25.41µs  max=782.78µs p(90)=98.81µs  p(95)=254.71µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.42s    min=770.34ms med=3.21s    max=7.47s    p(90)=4.28s    p(95)=4.54s   
     http_reqs......................: 885     28.728079/s
     iteration_duration.............: avg=3.44s    min=785.2ms  med=3.22s    max=7.48s    p(90)=4.29s    p(95)=4.55s   
     iterations.....................: 885     28.728079/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2352      ✗ 0    
     data_received..................: 69 MB   2.1 MB/s
     data_sent......................: 931 kB  29 kB/s
     http_req_blocked...............: avg=270.11µs min=1.39µs  med=4.04µs   max=10.09ms p(90)=536.07µs p(95)=1.59ms  
     http_req_connecting............: avg=240.52µs min=0s      med=0s       max=6.13ms  p(90)=406.02µs p(95)=1.47ms  
     http_req_duration..............: avg=4.03s    min=1.68s   med=3.77s    max=8.75s   p(90)=5.58s    p(95)=6.45s   
       { expected_response:true }...: avg=4.03s    min=1.68s   med=3.77s    max=8.75s   p(90)=5.58s    p(95)=6.45s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 784  
     http_req_receiving.............: avg=2.59ms   min=41.27µs med=175.22µs max=83.24ms p(90)=2.65ms   p(95)=4.92ms  
     http_req_sending...............: avg=126.13µs min=8.04µs  med=23.4µs   max=3.8ms   p(90)=139.45µs p(95)=788.88µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.03s    min=1.68s   med=3.77s    max=8.75s   p(90)=5.58s    p(95)=6.45s   
     http_reqs......................: 784     24.169472/s
     iteration_duration.............: avg=4.05s    min=1.69s   med=3.79s    max=8.77s   p(90)=5.6s     p(95)=6.47s   
     iterations.....................: 784     24.169472/s
     vus............................: 38      min=38      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:13:31Z

Overview for: `federation-v1/ramping-vus`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Gateway	duration(p95)⬇️	RPS	Requests	Durations	Notes
cosmo	2111ms	180	12645 total, 0 failed	avg: 709ms, p95: 2112ms, max: 4959ms, med: 457ms	✅
wundergraph	2386ms	159	11163 total, 0 failed	avg: 866ms, p95: 2386ms, max: 7046ms, med: 655ms	✅
apollo-router	2716ms	165	11594 total, 0 failed	avg: 821ms, p95: 2716ms, max: 9428ms, med: 510ms	✅
mesh-supergraph-bun	6261ms	99	6960 total, 0 failed	avg: 2654ms, p95: 6262ms, max: 10247ms, med: 2409ms	✅
mesh-supergraph	7914ms	56	3942 total, 0 failed	avg: 4884ms, p95: 7915ms, max: 9527ms, med: 4932ms	✅
apollo-server	23383ms	69	5056 total, 0 failed	avg: 4119ms, p95: 23384ms, max: 44772ms, med: 2194ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37935      ✗ 0    
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   214 kB/s
     http_req_blocked...............: avg=19.83ms  min=1.54µs  med=3.18µs   max=3.64s  p(90)=5.17µs   p(95)=13.65µs 
     http_req_connecting............: avg=18.27ms  min=0s      med=0s       max=3.64s  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=709.13ms min=3.86ms  med=457.13ms max=4.95s  p(90)=1.74s    p(95)=2.11s   
       { expected_response:true }...: avg=709.13ms min=3.86ms  med=457.13ms max=4.95s  p(90)=1.74s    p(95)=2.11s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12645
     http_req_receiving.............: avg=247.39ms min=31.68µs med=85.63µs  max=4.05s  p(90)=1.04s    p(95)=1.56s   
     http_req_sending...............: avg=39.68ms  min=8.01µs  med=15.53µs  max=2.95s  p(90)=1.59ms   p(95)=118.37ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=422.05ms min=3.77ms  med=289.19ms max=3.19s  p(90)=980.19ms p(95)=1.23s   
     http_reqs......................: 12645   180.625734/s
     iteration_duration.............: avg=1.44s    min=9.33ms  med=985.36ms max=10.29s p(90)=3.42s    p(95)=4.31s   
     iterations.....................: 12645   180.625734/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33489      ✗ 0    
     data_received..................: 980 MB  14 MB/s
     data_sent......................: 13 MB   189 kB/s
     http_req_blocked...............: avg=30.99ms  min=1.74µs  med=3.24µs   max=6.79s  p(90)=5.27µs   p(95)=25.08µs 
     http_req_connecting............: avg=24.12ms  min=0s      med=0s       max=3.94s  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=865.89ms min=6.18ms  med=654.78ms max=7.04s  p(90)=1.88s    p(95)=2.38s   
       { expected_response:true }...: avg=865.89ms min=6.18ms  med=654.78ms max=7.04s  p(90)=1.88s    p(95)=2.38s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11163
     http_req_receiving.............: avg=252.1ms  min=34.34µs med=85.2µs   max=5.32s  p(90)=989.76ms p(95)=1.51s   
     http_req_sending...............: avg=34.72ms  min=8.38µs  med=14.85µs  max=4.31s  p(90)=7.52ms   p(95)=150.01ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=579.06ms min=6.04ms  med=465.66ms max=3.12s  p(90)=1.19s    p(95)=1.47s   
     http_reqs......................: 11163   159.434227/s
     iteration_duration.............: avg=1.64s    min=12.77ms med=1.25s    max=12.88s p(90)=3.62s    p(95)=4.6s    
     iterations.....................: 11163   159.434227/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34782      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   197 kB/s
     http_req_blocked...............: avg=19.01ms  min=1.39µs  med=3.41µs   max=4.48s  p(90)=5.76µs   p(95)=22.91µs
     http_req_connecting............: avg=17.94ms  min=0s      med=0s       max=4.48s  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=820.71ms min=6.17ms  med=509.61ms max=9.42s  p(90)=1.96s    p(95)=2.71s  
       { expected_response:true }...: avg=820.71ms min=6.17ms  med=509.61ms max=9.42s  p(90)=1.96s    p(95)=2.71s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11594
     http_req_receiving.............: avg=329.22ms min=31.78µs med=85.2µs   max=6.81s  p(90)=1.31s    p(95)=2.09s  
     http_req_sending...............: avg=34.23ms  min=8.56µs  med=16.18µs  max=5.7s   p(90)=554.98µs p(95)=80.64ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=457.24ms min=6.1ms   med=371.21ms max=2.42s  p(90)=962.86ms p(95)=1.12s  
     http_reqs......................: 11594   165.606483/s
     iteration_duration.............: avg=1.59s    min=12.2ms  med=1.05s    max=13.68s p(90)=3.92s    p(95)=4.97s  
     iterations.....................: 11594   165.606483/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20880     ✗ 0    
     data_received..................: 611 MB  8.7 MB/s
     data_sent......................: 8.3 MB  118 kB/s
     http_req_blocked...............: avg=1.97ms  min=1.62µs  med=3.1µs   max=485.26ms p(90)=6.12µs  p(95)=235.58µs
     http_req_connecting............: avg=1.92ms  min=0s      med=0s      max=485.19ms p(90)=0s      p(95)=157.16µs
     http_req_duration..............: avg=2.65s   min=7.51ms  med=2.4s    max=10.24s   p(90)=5.24s   p(95)=6.26s   
       { expected_response:true }...: avg=2.65s   min=7.51ms  med=2.4s    max=10.24s   p(90)=5.24s   p(95)=6.26s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 6960 
     http_req_receiving.............: avg=29.94ms min=35.76µs med=78.2µs  max=1.86s    p(90)=16.21ms p(95)=172.73ms
     http_req_sending...............: avg=2.28ms  min=8.61µs  med=14.38µs max=368.61ms p(90)=75.94µs p(95)=5.11ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=2.62s   min=7.35ms  med=2.37s   max=10.17s   p(90)=5.22s   p(95)=6.23s   
     http_reqs......................: 6960    99.417888/s
     iteration_duration.............: avg=2.73s   min=13.68ms med=2.55s   max=10.37s   p(90)=5.31s   p(95)=6.41s   
     iterations.....................: 6960    99.417888/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 11826     ✗ 0    
     data_received..................: 346 MB  4.9 MB/s
     data_sent......................: 4.7 MB  67 kB/s
     http_req_blocked...............: avg=321.92µs min=1.43µs  med=4.39µs   max=102.74ms p(90)=202.64µs p(95)=419.57µs
     http_req_connecting............: avg=305.54µs min=0s      med=0s       max=102.66ms p(90)=140.26µs p(95)=325.31µs
     http_req_duration..............: avg=4.88s    min=21.98ms med=4.93s    max=9.52s    p(90)=7.61s    p(95)=7.91s   
       { expected_response:true }...: avg=4.88s    min=21.98ms med=4.93s    max=9.52s    p(90)=7.61s    p(95)=7.91s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3942 
     http_req_receiving.............: avg=1.26ms   min=39.61µs med=125.08µs max=117.53ms p(90)=2.55ms   p(95)=5.04ms  
     http_req_sending...............: avg=339.23µs min=8.7µs   med=25.25µs  max=72.23ms  p(90)=59.44µs  p(95)=122.24µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.88s    min=21.84ms med=4.93s    max=9.52s    p(90)=7.61s    p(95)=7.91s   
     http_reqs......................: 3942    56.309125/s
     iteration_duration.............: avg=4.91s    min=37.61ms med=4.95s    max=9.54s    p(90)=7.66s    p(95)=7.94s   
     iterations.....................: 3942    56.309125/s
     vus............................: 2       min=2       max=499
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15168     ✗ 0    
     data_received..................: 444 MB  6.1 MB/s
     data_sent......................: 6.0 MB  82 kB/s
     http_req_blocked...............: avg=109.27µs min=1.63µs  med=3.98µs   max=76.19ms p(90)=41.83µs  p(95)=247.47µs
     http_req_connecting............: avg=96.5µs   min=0s      med=0s       max=75.96ms p(90)=0s       p(95)=171.45µs
     http_req_duration..............: avg=4.11s    min=79.39ms med=2.19s    max=44.77s  p(90)=3.55s    p(95)=23.38s  
       { expected_response:true }...: avg=4.11s    min=79.39ms med=2.19s    max=44.77s  p(90)=3.55s    p(95)=23.38s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 5056 
     http_req_receiving.............: avg=318.09µs min=45.4µs  med=120.93µs max=227.4ms p(90)=220.13µs p(95)=330.08µs
     http_req_sending...............: avg=106.99µs min=9.68µs  med=21.52µs  max=43.28ms p(90)=46.55µs  p(95)=64.98µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.11s    min=79.25ms med=2.19s    max=44.77s  p(90)=3.55s    p(95)=23.38s  
     http_reqs......................: 5056    69.083809/s
     iteration_duration.............: avg=4.13s    min=91.18ms med=2.2s     max=44.77s  p(90)=3.56s    p(95)=23.39s  
     iterations.....................: 5056    69.083809/s
     vus............................: 14      min=14      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

renovate bot force-pushed the renovate/tsx-4.x branch from 5b82808 to d074081 Compare April 25, 2024 14:16

renovate bot changed the title ~~Update dependency tsx to v4.7.2~~ Update dependency tsx to v4.7.3 Apr 25, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from d074081 to 6c28531 Compare May 1, 2024 14:09

renovate bot changed the title ~~Update dependency tsx to v4.7.3~~ Update dependency tsx to v4.8.2 May 1, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 6c28531 to 7965e21 Compare May 3, 2024 10:59

renovate bot changed the title ~~Update dependency tsx to v4.8.2~~ Update dependency tsx to v4.9.0 May 3, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 7965e21 to c195616 Compare May 4, 2024 15:31

renovate bot changed the title ~~Update dependency tsx to v4.9.0~~ Update dependency tsx to v4.9.1 May 4, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from c195616 to fe7be34 Compare May 6, 2024 01:25

renovate bot changed the title ~~Update dependency tsx to v4.9.1~~ Update dependency tsx to v4.9.2 May 6, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from fe7be34 to a3f5db0 Compare May 6, 2024 03:04

renovate bot changed the title ~~Update dependency tsx to v4.9.2~~ Update dependency tsx to v4.9.3 May 6, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from a3f5db0 to 40e8aa0 Compare May 10, 2024 17:02

renovate bot changed the title ~~Update dependency tsx to v4.9.3~~ Update dependency tsx to v4.9.4 May 10, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 40e8aa0 to 45c2037 Compare May 11, 2024 14:00

renovate bot changed the title ~~Update dependency tsx to v4.9.4~~ Update dependency tsx to v4.9.5 May 11, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 45c2037 to 5cd539d Compare May 11, 2024 16:37

renovate bot changed the title ~~Update dependency tsx to v4.9.5~~ Update dependency tsx to v4.10.0 May 11, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 5cd539d to 1dcede9 Compare May 12, 2024 12:12

renovate bot changed the title ~~Update dependency tsx to v4.10.0~~ Update dependency tsx to v4.10.1 May 12, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 1dcede9 to ec3619e Compare May 13, 2024 14:07

renovate bot changed the title ~~Update dependency tsx to v4.10.1~~ Update dependency tsx to v4.10.2 May 13, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from ec3619e to 59fced4 Compare May 16, 2024 17:40

renovate bot changed the title ~~Update dependency tsx to v4.10.2~~ Update dependency tsx to v4.10.3 May 16, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 59fced4 to 10c7d3f Compare May 17, 2024 06:02

renovate bot changed the title ~~Update dependency tsx to v4.10.3~~ Update dependency tsx to v4.10.4 May 17, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 10c7d3f to ed5d367 Compare May 18, 2024 12:28

renovate bot changed the title ~~Update dependency tsx to v4.10.4~~ Update dependency tsx to v4.10.5 May 18, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from ed5d367 to 0306e10 Compare May 23, 2024 04:15

renovate bot changed the title ~~Update dependency tsx to v4.10.5~~ Update dependency tsx to v4.11.0 May 23, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 047358c to d5f2534 Compare July 5, 2024 00:01

renovate bot changed the title ~~Update dependency tsx to v4.16.0~~ Update dependency tsx to v4.16.2 Jul 5, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from d5f2534 to 11db885 Compare July 31, 2024 04:20

renovate bot changed the title ~~Update dependency tsx to v4.16.2~~ Update dependency tsx to v4.16.3 Jul 31, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 11db885 to b354c62 Compare August 1, 2024 23:38

renovate bot changed the title ~~Update dependency tsx to v4.16.3~~ Update dependency tsx to v4.16.5 Aug 1, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from b354c62 to bca933b Compare August 8, 2024 09:17

renovate bot changed the title ~~Update dependency tsx to v4.16.5~~ Update dependency tsx to v4.17.0 Aug 8, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from bca933b to d7c2f6a Compare August 24, 2024 16:10

renovate bot changed the title ~~Update dependency tsx to v4.17.0~~ Update dependency tsx to v4.17.1 Aug 24, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from d7c2f6a to 3a81ce4 Compare August 24, 2024 18:03

renovate bot changed the title ~~Update dependency tsx to v4.17.1~~ Update dependency tsx to v4.18.0 Aug 24, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 3a81ce4 to 44c44a6 Compare August 27, 2024 11:36

renovate bot changed the title ~~Update dependency tsx to v4.18.0~~ Update dependency tsx to v4.19.0 Aug 27, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 44c44a6 to 79f063e Compare September 12, 2024 07:35

renovate bot changed the title ~~Update dependency tsx to v4.19.0~~ Update dependency tsx to v4.19.1 Sep 12, 2024

renovate bot force-pushed the renovate/tsx-4.x branch from 79f063e to 75161b5 Compare October 2, 2024 13:01

renovate bot force-pushed the renovate/tsx-4.x branch 5 times, most recently from 9547d7d to 8e5ea8f Compare October 2, 2024 16:23

Update dependency tsx to v4.19.1

8373e07

renovate bot force-pushed the renovate/tsx-4.x branch from 8e5ea8f to 8373e07 Compare October 2, 2024 18:56

renovate bot merged commit 0d7d3ad into main Oct 2, 2024
33 checks passed

renovate bot deleted the renovate/tsx-4.x branch October 2, 2024 21:29

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update dependency tsx to v4.19.1 #434

Update dependency tsx to v4.19.1 #434

Uh oh!

renovate bot commented Apr 8, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

Update dependency tsx to v4.19.1 #434

Update dependency tsx to v4.19.1 #434

Uh oh!

Conversation

renovate bot commented Apr 8, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Release Notes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Features

Bug Fixes

Features

Bug Fixes

Bug Fixes

Bug Fixes

Features

Bug Fixes

Bug Fixes

Features

Performance Improvements

Bug Fixes

Bug Fixes

Bug Fixes

Features

Bug Fixes

Performance Improvements

Features

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Bug Fixes

Configuration

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-over-time

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-subgraphs-delay

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/ramping-vus

Comparison

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

renovate bot commented Apr 8, 2024 •

edited

Loading

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-over-time`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-subgraphs-delay-resources`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-subgraphs-delay`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/ramping-vus`